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ABSTRACT 

An assessment of the impact that funding mechanisms 
had on the productivity and performance of university research is 
presented in this report. The General Accounting Office (GAO) study 
focused on five universities that had reputed improvement in program 
quality. The GAO study concentrated primarily on what funding and 
other strategies these universities used to improve selected 
departments and how these departments were able to finance their 
improvement initiatives. Specific questions examined were whether 
particular funding mechanisms played a role in helping universities 
improve program quality ind whether two funding mechanisms, i.e., 
individual project grants and center grants had different effects on 
the performance cf research. It was found that at the five 
universities GAO visited, the common element in imp. oven ^nt was an 
explicit commitment from the university to improve quality through 
increases in internal anc'/or external funding and personnel changes. 
Initial funding was necessary for building quality, although it came 
from a variety of sources. An appendix contains a summary of 
scientists' responses to selected questions on research funding. 
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GAO 



United Sutes 

General Accounting Offlce 

Washington, D.C. 20648 



Resources, Community, and 
Economic Development Division 

B-221714 



^^B 7 1986 



Th? Honorable Don Fuqua 

CI. iirman, Committee on Science and Technology 
House of Representatives 

Dear Mr. Chairman: 

As requested In your November 2, 1984, letter, we have assessed the 
Impact of funding mechanism! on the productivity and performanca of 
university research. This report discusses the role particular funding 
mechanisms played In helping universities Improve program quality and 
different effects Individual project grants and center grants had on the 
performance of research. 

We are jendlng copies of this report to appropriate committees of both 
Houses, the Director of the Office of Management and Budget, the 
Director ot the Office of Science and Technology Policy, and the chief 
officials of the following federal agencies: the Departments of 
Agriculture, Fnergy, and Defense; the National Aeronautics and Space 
Administration; the National Institutes of Health; and the National 
Science Fnundation. We are also making copies available to Interested 
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Executive Summary 



Over 60 percent of university research funding comes from federal 
agencies. This research is a key element in the United States* interna- 
tional competitivenes'3 and technology advancement. Other sources for 
research funding include industry, foundations, and state governments. 

Approximately 71 percent of the federal research funds are provided 
through one funding mechanism or category of federal financial support 
for scientific research— individual project grants. Some scientists and 
policymakers have questioned the consequences of such heavy reliance 
on individual project grants. For example, does this mechanism dis- 
courage the performance of innovative, high-risk, and interdisciplinary 
research? 

In response to the House Committee on Science and Technology's 
request that GAO assess the effects of different funding mechanisms on 
the productivity and performance of research, gao looked at: 

Whether particular funding mechanisms played a role in helping univer- 
sities improve program quality. 

Whether two funding mechanisms — individual project grants and center 
grants — had different effects on the performance of research. 

In addition, gag is providing the Committee with a separate report that 
describes the funding mechanisms used by federal agencies to support 
university research and trends in the use of such mechanisms 



GAO looked at five universities that, according to surveys of the scien- 
tific community carried out by two education and research organiza- 
tions, had reputed improvement in program quality, gao concentrated 
primarily on what funding and other strategies these universities used 
to improve the selected departments and how the departments were 
able to finance their program improvement initiatives. 

Two mechanisms for federal funding of university research are indi- 
vidual project grants and center grants. Individual project grants sup- 
port individual researchers who do specific research. Center grants, 
which account for 9 percent of grants awarded, support broad coherent 
research programs and include coverage of facilities, equipment, and 
scientific and administrative personnel. 

GAO assessed the merits of the two funding mechanisms against four fac- 
tors that have the potential to affect the performance of research: 
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• Coverage of resource requirements, which includes trained technicians, 
equipment, and laboratory space. 

• Stability of financial and resource support, which reflects the continuity 
and duration of support. 

• Type of research supported, which includes the influence of funding 
availability on tha flexibility to pursue new and different areas of 
research. 

• Administrative burden, which includes researchers' time spent pre- 
paring proposals, overseeing grants, and reviewing proposals by others. 



Results in Brief ^'^^ particular funding mechanism for university research played a 

lesser role in helping universities improve program quality than their 
ability to obtain grant funds from such sources as the federal govern- 
ment, state government, industry, and the university itself. 



Responses of scientists to gag's questions on coverage of resource 
requirements and administrative burden showed that these factors were 
less affected by the particular funding mechanism than by the field of 
science. On the other hand, scientists working under center grants 
responded that they had more stability of financial and resource sup- 
port and that they were more likely to perform the types of research 
defined as innovative, high risk, or interdisciplinary than scientists 
working under individual project grants. 



GAO's Analysis 



Improving Research Quality At the five universities gag visited that were reputed to have improved 

program quality, the common element in impr wement was an explicit 
commitment from the university to improve quality through increases in 
internal and/or external funding and personnel changes. Initial funding 
was necessary for building quality, although it came from a variety of 
sources. Two of the universities received National Science Foundation 
science development grants in the late 1960's that enabled them to bring 
in high-quality junior and senior faculty. Another university received 
state appropriations that were used to hire new faculty and increase the 
number and quality of postdoctoral fellows. Another university used 
funds from industrial sponsors to implement its plan for program 
improvement. (See chapter 2.) 
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Performance of Research Coverage of resource requirements differed by field of science rather 

than by the type of funding mechanism (individual project or center 
grant). Fields of science differ in their needs for such resources as tech- 
nicians, equipment, and laboratory space. For example, mathematicians 
working on theories may work in isolation with few assistants and little 
or no equipment. In contrast, cell biologists may need a number of lab 
assistants, and space scientists may invest large amounts of capital in 
equipment. 

Scientists' concerns about stability of resources and financial er ^^iron- 
ment differed depending on their field of science rather than on the 
funding mechanism. For example, award duration affects sta' 'lity 
because award periods do not always match the actual time needed to 
perform research. Biochemistry projects may take less time to complete 
than genetic manipulation experiments in agriculture, where scientists 
must allow a complete new generation of crops to grow before testing 
can take place. 

Scientists working under center grants reported that they were more 
likely to perform types of research defined by the National Science 
Foundation as innovative, high risk, or interdisciplinary than scientists 
receiving individual project grants. For example, 25 out of 32 scientists 
with center grants said they proposed research into new areas as 
opposed to 14 out of 33 scientists receiving individual grants. Scientists 
working under center grants believed they had more stability and 
resources to conduct these types of research. 

Administrative burden, as measured by the amount of time spent in 
preaward activities (applying for awards) and postaward activities 
(responding to award requirements and reviewing proposals), varied 
more by field of science and agency requirements than by type of mech- 
anism. Defense agency award requirements include postgrant reporting, 
while civilian agency award requirements include more preaward 
reviews of proposed research. On the average, scientists in fields, such 
as artificial intelligence, that receive awards from defense agencies, 
reported they spent more time in postaward activities than in preaward 
activities. Scientists in fields, such as plant science, that receive awards 
from civilian agencies reported spending more time in preaward activi- 
ties. (See chapter 3.) 



Recommendations rmklng m recommendations. 



ERiC 



Page 4 



,^ GAO/RCEim'75 Univertity Pundliig 
6 



Execudve SumuiAxy 



AfienCV CominentS request agency comments 'jecause ou: work v/as not carried 

out at any agencies and we do not have any adverse conunents about 
any agencies or organii-ations. However, we requested comments on por- 
tions of the report from the five universities cited in chapter 2 as having 
improved program quality. Those i^omments are incorporated in this 
report. 



ERiC 



Paged 



7 



GAO/^CEMA-lfi ITniverHty FimdiiiC 



Contents 



Executive Summary 




2 


Chapter 1 




8 


Introduction 


How the Current Funding System Supports Scientists 


8 


Obiprtivps Sronp anrf Mpthodolo^v 


q 


Chapter 2 




14 


Role of Funding 


Emo:y University 


15 


Mechanisms in 


Georgia Institute of Technology 
University of Alabama in Birmingham 


17 
18 


Improving The Quality 


University of Georgia 


19 


of Universitv Science 


University of Texas at Austin 
Sunmiary 


21 

22 


Chapter 3 




24 


Role of Funding 


Coverage of Resource Requirements 


25 


ivitx.ndiiisiitb 111 ine 


Stability of Financial and Resource Support 
Types of Research 


28 
31 


Performance of 


Administrative Burden 


31 


Research 


Summary 


34 


Appendixes 


Appendix I: Summary of All Scientists' Responses to 


36 




Selected Questions 




Tables 


Xauie 1.1. umveraitiea wiin ivepuieu improvemeni m 


1 n 




jriu^rdiii v^Uaiiiy 






Table 1.2: Matched Pairs of Universities 


12 




Table 2.1: Characteristics of Departments With Improved 


15 




Program Quality 






Table 3.1: Facilities 


26 




Table 3.2: Equipment 


26 




Table 3.3: Technicians 


27 




Table 3.4: Funding Cuts 


28 




Table 3.5: Changes Over the Last 15 Years in Areas 


29 




Affecting Research Performance 






Table 3.6: Funding Gaps 


30 




Table 3.7: Experience With Federal Awardo 


30 



ERLC 



Page« 



8 



GAO/RCEI>86>75 University Funding 



Content* 



Table 3.8: Average Time Spent by Scientists in Award- 33 
Related Activities 

Table 3.9: Shifting Funds 34 



Abbreviations 

GAO General Accounting Office 
NIH National Institutes of Health 
NSF National Science Foundation 



ERiC 



Pa«e7 



GAO/RCEI>^76 University Funding 

9 



Chapter 1 



Introduction 



Since its inception in the late 1940's, the current U.S. system for scien- 
tific research has emphasized supporting individual scientists' research 
projects through national competition for awards. According to the 
National Academy of Sciences, the scientific community often associates 
the individual project av^^ard system with the success of U.S. basic 
research and viev/s it as affording the greatest degree of opportunity for 
pursuit of meritorious ideas. 

Despite the belief that the individual project mechanism is closely linked 
with U.S. success in basic research, the House Committee on Science and 
Technology has noted problems concerning the current funding system 
in which this award type predominates. This report, which was 
requested by the House Committee on Science and Technology, assesses 
the roles and impact of different kinds of support for imiversity scien- 
tific research in different fields of science. 

Among the problems with the current system noted by the Conunittee 
and others, such as the National Academy of Sciences, are: 

• the increased volume of applications for research support that need to 
bp reviewed; 

• the tendency to fund traditional research ideas rather than innovative 
ones; and 

• constraints in the provision of scientific research resources, such as 
equipment and personnel. 



Scientific research in the universities depends heavily on the federal 
govermnent. In fiscal year 1982 federal agencies provided 64 percent of 
the $7.3 billion spent at universities for research. The federal govern- 
ment supports university research through a variety of funding mecha- 
nisms. For purposes of this report, funding mechanisms are categories of 
federal-financial support for scientific research performed by U.S. uni- 
versities; they can be divided into direct and indirect support. 

Three funding mechanisms directly support research: the individual 
project mechanism, program support, and center support. Individual 
project awards are typically made to individual scientists for research 
that they have proposed in a discrete research area. This is by far the 
predominant mechanism, accounting for 71 percent of agency support. 
Program support provides support for more than one principal investi- 
gator in a broad coherent program of research, often multidisciplinary 
and long term. Center support provides funding for research projects 



How the Current 
Funding System 
Supports Scientists 
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that are coordinated into a coherent program in a broad field of interest 
at a university. The center award is the only mechanism that provides 
funding both for research and for equipment, facilities, and an adminis- 
trative unit in the university. A recent illustration of the use of this 
funding mechanism is the National Science Foundation's (nsf's) estab- 
lishment of engineering research centers, designed to strengthen thie 
field by providing a concentration of facilities, personnel, and 
equipment. 

Three other funding mechanisms indirectly support research by pro- 
viding funds for ^^infrastructure.'' These funding mechanisms are 
training, equipment and facilities support, and institutional support for 
a university. 



The House Committee on Science and Technology requested that gao 
assess the relative meiits of different funding mechanisms in terms of 
their effects on the type of research being supported, research perform- 
ance and productivity, agency procurement administration, manage- 
ment and administration by the performing organization, and from the 
point of view of the individual scientist. As a result of a literature 
review, the advice of a panel of experts, and consultations with the 
Ck)nunittee, v/e agreed to assess funding mechanisms as they are used by 
recipients in different fields of science at specific research organiza- 
tions. Our objectives in this assessment were 

• to determine whether particular funuing mechanisms play a role in 
helping universities improve program quality as perceived by the scien- 
tific conununity and 

• to examine whether two different types of funding mechanisms — indi- 
vidual project grants and cent?r grants — had different impacts on the 
performance of research. 

Because almost no empirically based literature exists on funding mecha- 
nisms and their effects on research organizations, we adopted an explor- 
atory approach to identify those issues that warrant further attention 
from policymakers. We conducted case studies at 15 different university 
research organizations. We used two sets of case studies, one focusing on 
reputed improvement in program quality, ai>d the other on research per- 
formance and the perspective of individual scientists. 

The Committee originally had included research productivity among the , 
factors it requested we review. However, we determined that we could 



Objectives, Scope, and 
Methodology 
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not precisely assess the effects of funding mechanisms on research 
quality and productivity because of current limitations in the techniques 
for measuring the outputs of research. Instead, in consultation with the 
(Committee, we explored the linkages between the types of support 
flowing into research organizations and the reputed research quality of 
those Programs. 

We focused on how selected university departments were able to 
improve their research programs after the federal government had 
largely eliminated special financial assistance for program improvement 
in the early 1970's. We selected five universities that had successfully 
iirproved various departments over the past decade on the basis of two 
national surveys of U.S. research doctoral programs. The first (**A 
Rating of Graduate Programs") was conducte^^ in 1969 by Kenneth D. 
Rouse and Charles J. An ierson for the Amen^^an Council of Education, 
and the other ("An Assessment of Research Doctoral Programs in the 
United States") was conducted by the Conference Board of Associated 
Research Councils and published in 1982. 

We used the following criteria to select the five universities after con- 
sulting with the study director of the 1982 survey. 

• First, where did departments stand in terms of the 1982 survey's 
ranking of program quality improvement as based on responses from 
sc' "»tists in the same field around the country. 

• Second, which departments showed the greatest change between 1969 
and 1982 in program reputation, again based on scientists' assessments. 

We visited the following universities and departments where we inter- 
viewed university administrators and faculty members and reviewed 
program improvement documentation and financial records. We looked 
at the role of funding mechanisms in the universities' program improve- 
ment strategies. Due to resource constraints, we foci;sed on departments 
in one geographic region— the southeastern United States. 



Table 1.1: Untvertmet With Reputed 
Improvement In Program duality 



Unlverelty 


Department/School 


Emory University 


Department of Microbiology and Immunology 


Georgia Institute of Technology 


School of Chemical Engineering 


University of Alabama in Birnningham 


Department of Physiology and Biophysics 


University of Texas at Austin 


Department of Physics 



University of Georgia Department o^ Botany 
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To respond to the Committee's interest in the effects of different 
funding mechanisms on the performance of research, we designed our 
second set of case studies to explore further soir , ot the problen cited 
with current federal support for university res< J"ch. Time and resource 
constraints prevented us from assessing all six categories of funding 
mechanisms, out the approach we took still sheds light on issues 
endemic to all funding mechanisms. Our objective in this second set of 
cases was to examine whether two different types of funding mecha- 
nisms had different imp . on the performance of research. To meet 
this second objective, we studied two funding mechanisms, center 
funding and the individual project award raechanism, that together rep- 
resent 80 percent of the federal doilars obligated for university 
reseai ch. We examined the impact of these two funding mechanisms by 
examining four factors related to the perfi Tnance of research: 

• coverage of research resource requirements, which includes trained 
technicians, equipment, and laboratory space; 

• the stability of support, vi hich reflects the continuity ai\d duration of 
support; 

• the type r ^ research supported, which includes the influence of funding 
availability on the flexibility to pursue new and different areas of 
research; and 

• administrative buiden, which includes researchers' time spent preparing 
proposals, overseeing grants, and reviewing proposals by others. 

The second set of cases was selected to allow us to examine the use of 
mechanisms historically, individually, and in combination at university 
research organizations. We chose a sample that matched two different 
typ^s of research organizations (centers and departments), which we 
assumed would have different experiences with funding mechanisms. 
We defined centers as research organizations where research projects 
are coordinated into a coherent program in a broad field o^ interest at 
the university. Another defiring chai a'^t^ristic of such organizations is 
core funding for equipment, facilities, and an administrative unit. We 
J'^^oked at centers that had received core funding from a government 
agency for at least 10 years and at departments that had received indi- 
vidual project awards in that same period of time. 

Our sample of matched pairs cut across five fields of science. The final 
match of departments was made on the basis of location and the degrees 
to which the department matched the center in terms of types of 
research done, and other factors, such as seniority of faculty members 
and coverage of distinctly different fields of science. The final sample is 



Page 11 



GAO/RCEim-75 Unlveratty Funding 



Chapter 1 
Introduction 



comprised of 10 of the 25 universities that received the most federal 
research and development support and represents a mix of public and 
private institutions. 



T»* le .2: Matched Pairs of Universities ■^^■^^■■^^^^^^^^■B^^^^^^^^^^^^^^k^^^h 

Field of science Center location s Department locations 

Mathematics University of Wisconsin- University jf Michigan 

Madison 

Space science University of Chicago University of Iowa 

Artificial intelligence Massachusetts Institute of University of Texas 
Technology 

Cell b iology Yale Unive^-sit y New ^ork University 

Plant xiences Michigan State University Cornell University 



In selecting different fields of science, we addressed the Comniittee's 
interest in the impact of different styles of support or combinations of 
funding mechanisms on various fields. 

Our data collection efforts involved the administration of a structured 
questionnaire to principal investigators at the various universities. We 
also asked universities to provide us with data on their use of different 
funding mechanisms from federal and noi^federal sources :n 1970, 1975, 
and 1984-85. 

The questionnaire was administered to assistant, associate, and full 
professors at the universities we visited. In all we interviewed 70 
research faculty. Using this questionnaire, we gathered data on a 
variety of factors bearing on the perceived impact of federal individual 
project grant awards versus federal center awards in terms of coverage 
of resources, stability, types of research, and adiaii^istrative burden. 
These factors are discussed in detail in chapter 3. 

In all cases, data were cross tabulated by type of research orgardzatic i 
(department or center) and by field of science (artificial intelligence, 
space science, mathematics, cell biology and plant science). In addition, a 
series of open-ended questions were asked to develop additional infor- 
mation about the perceived effects of funding on scientific research. 
These questions were designed to create small-scale case studies when 
the comments of all scientisUi in a particular center or department were 
aggregated. 

Since the case study approach was used to address both objectives, an 
important caveat must be noted. Our study is not representative of all 
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fields of science, the totality of U.S. research universities, or all federal 
agencies or components of agencies. 

We did not request agency coir.nents because our work was not carried 
out at any agencies and we do not have any adverse comments about 
any agencies or organizations. However, we requested comments on por- 
tions of the repoi*^ from the five universities cited in chapter 2 as having 
improved program quality. Those comments are incorporated in this 
report. 
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Role of Funding Mechanisms in Improving the 
Quality of University Science 



This chapter assesses the role of funding mechanisms in improving the 
perceived program quality of university science departments. In the 
lt^60's federal agencies developed several funding mechanisms designed 
either to create new research expertise or to increase existing research 
expertise. These funding mechanisms had been discontinued by the 
early 1970's. In an effort to determine how selected 'iniversity depart- 
ments c?re able to improve their academic and research programs when 
the federal government had eliminated special financial assistance for 
research program improvement, we visited five universities that 
according to national surveys had successfully improved various 
depa^ ments over the past few years. (See objectives, scope, and meth- 
odology in chapter 1.) This chapter concentrates primarily on what 
fund'ng and other strategies these universities used to improve the 
selected departments and how the departments were able to finance 
their program improvement initiatives. 

We found that these departments financed program improvement plans 
by obtaining funds from federal grants, state government, industry, or 
university sources. With these funds the departments hired additional 
faculty, renovated research facilities, and purchased new equipment. 
These actions contributed to the quality of their research programs and 
enabled the departments to compete successfully for additional external 
grants and contracts. Although the departments used a variety of 
funding mechanisms, the individual project grant was the principal 
mechanism used by all the departments. Two departments received spe- 
cial science development grants from the National Science Foundation in 
the mid-1960's. Table 2 1 briefly summarizes the information we found 
concerning these funding mechanisms and program improvement strate- 
gies for these five departments. More detailed summaries follow the 
table. 
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Tabie 2.1: Characterittics of Departments With Improved Program Quality 

FundSng sources used to improve 
University program 



Federal research funds 
1970 1984 



^ nory 
University, 
Microbiology 
and 

Immunology 
Department 



University awarded $620,000 to 
department as seed money 



Percent 

Change Key elements of improvement 



$ 140,460 $1,158,441 



+725 Seed funding used to increase the 
number of tenured faculty members; 
new department chairman in 1979 



Georgia 
Institute of 
Technology, 
School of 
Chemical 
Engineering 



Increase in support fron industry, 
federal government, and foundations 
(industrial sponsors) 



149,016 754.273 



+406 1978 implementation of written pian 
for improvement of program, Plan 
focused on faculty recruitment and 
improving university relations with 
industry 



University of 
Alabama at 
Birminaham, 
Physiology 
and 

Biophysics 
Department 



Seed nnoney frorr state 
appropriations 



240.401 2,488.969 



+935 New chairman in 1979, focus on hiring 
new faculty and increasing the 
number and qu«*'1y of postdoctoral 
fellows 



University of 1967 NSF Science Development grant 
Georgia, of $972,000 matched by an infusion of 
Botany state funds and start-up funds from 
Department the university for new researchers 
Individual research grant sustains 
program improvenn.?nt. unrestricted 
income from an encowment fund 



405.695 1.673,87^ 



+313 Support through a variety of funding 
mechanisms allowed expansion of 
space for faculty and student 
researcti and the addition of more 
faculty, equipment, graduate 
students, and postdoctoral fellowr.. 



University of 
Texas at 
Austin, 
Physics 
Department 



1966 NSF Science Davelopment 
grant. Department strengthened by 
income from private endowment 



1.762.154 7.825,487 



+344 Science Development Grant provided 
the opportunity to bring in hiah- 
quality junior and senior faculty with 
initial research support 
University funding procedures 
enhanced acquisition of equipment. 

thereby improving program quality. 



Emory University chairman of the Microbiology and Immunology Department told us 

that the department began its greatest period of growth and improve- 
ment in 1979, when he was hired. The chairman described the depart- 
ment at that time as a modest, but decent one, which he believed could 
be expanded into a well-balanced, nationally recognized, high-quality 
department. The university's administration also wanted to improve the 
quality of the department and agreed to provide about $620,000 in 
''seed money'' to increase the number of tenured faculty. Additional 
funds were provided to acquire more modem equipment for instruc- 
tional and research purposes and to support additional graduate and 
postgraduate students. In addition, the university agreed to renovate 
space for the Microbiology and Immunology Department. According to 
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the department chairman, renovation costs were between $1.5 million 
and $1.75 million. 

The chairman told us that the first priority for improving the depart- 
ment was to hire additional faculty members who were highly trained, 
prominent in their field, and who would aggressively seek external 
research funds through grants and contracts. When the chairman was 
hired in 1979, the department had eight faculty members. Today, the 
department has 1 1 faculty members, 5 of whom have been hired since 
the new chairman came on board. The current faculty has successfully 
increased the department's external funding from about $240,000 in 
1979 to over $ 1.5 million in 1985, including about $1.4 million in federal 
funds. The department would like to increase its faculty to 16 or 18 
members, but current space constraints have precluded further growth. 

Acquiring additional equipment for research and instructional purposes 
was another high priority for improving the department. A 1978 
appraisal of the department's laboratories concluded that existing 
equipment was not suitable for modem research approaches in microbi- 
ology . Since then, the department has purchased several new pieces of 
equipment. 

According to the department chairman, applicants for predoctoral and 
postdoctoral training in the departnient have also increased in number 
and quality. In 1979 the Microbiology and Inmiunology Deparcment had 
only 5 graduate stuoents; today it has 24. The department has provided 
financial support for six of the predoctoral and postdoctoral students 
through a training grant from the National Institutes of Health (NIH). 
This grant, which began in July 1984, will provide a total of $499,640 
over a 5-yecir period. The university has also increased its student fel- 
lowship support for this department from $32,500 in 1979 to a 1985 
level of $65,700 per year. 

nih's Biomedical Research Support Grant provides additional funds on 
the basis of total amount of nih grant dollars received by Emory. The 
university then shares these funds with various departments as the 
need arises, for example, to puiohase expensive pieces of research 
equipment or provide interim 5,upport for faculty who are **between 
research grants.'' Research funds from the Multiple Sclerosis Society, 
the American Cancer Society, the Rockefeller Foundation, and the state 
of Georgia provided about $ 150,000 in 1984, or about 1 1 percent of the 
department's external research funds. Because Emory is a private uni- 
versity, it does not receive an appropriation from the state of Georgia. 
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School of Chemical Engineering officials told us that substantial 
improvements that were made in the quality of its faculty, graduate stu- 
dents, and educational program would not have been possible without a 
flexible university administration, a determined newly appointed Chem- 
ical Engineering director, and a supportive faculty. In a time of 
decreasing federal support for program imr vement. Chemical Engi- 
neering developed a comprehensive written ^ ^2n for improving the 
quality of its program. The essence of its plan was to achieve excellence 
by improving the quality of its faculty and graduate students. 
Improving relations with industry was also a priority. 

Since 1978 the Chemical Engineering School h.is successfully attracted 
11 new faculty members. The Director of Chemical Engineering, in 
reflecting on the improvement in quality of the school, cited a number of 
factors responsible for the successful recruitment of highly qualified 
new faculty. The factors he cited were 

• a perception that the rapidly changing Georgia Tech Chemical Engi- 
neering program would be a good place to build or continue a career, 

• the willingness of the Dean of Engineering to permit the school to recruit 
faculty at all ranks, and 

• attractiveness as a place to work and live. 

Faculty recruitment took priority over building the Chemical Engi- 
neering graduate enrollment. The depaument established an initial goal 
of four to five graduate students per faculty member and carried out 
extensive recruiting efforts to achieve that goal. In the summer of 1978 
Chemical Engineering had only 12 graduate students; today, it has j.bout 
100. 

In addition to improving the quality of faculty and graduate students, 
improving communications and relationships with industry was also a 
priority of the school director. He believed a good relationship with 
industry not only enhances educational opportunities for the students, 
bui also increases industry's financial support for the program and con- 
tributes to the institution's stature. Activities aimed at improving the 
school's external relationships, including industry, during the past few 
years included 

• establishing external advisory boards comprised of industrial and aca- 
demic represe ntatives interested in the program, 

• publishing a ^iCw graduate program booklet containing specific program 
information and listing the research interests of individual faculty, 
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• issuing an annual alunmi newsletter since 1979, and 

• pursuing opportunities for interaction with industrial representatives. 

The budget for Chemical Engineering has increased dra^ latically during 
the past 15 years. In 1970 the budget was approximately $582,000, but 
by 1984 the budget had grown to more than $3.5 million. The greatest 
budget increases have occurred since 1978, the year the new director 
was hired. 

The increase in funds has come from several sources including the state 
of Georgia, the federal government, and industry. Because the Chemical 
Engineering School performs extensive research, a substantial part of its 
funds come from grants and contracts from industry and government 
agencies. In 1970 the state of Georgia supplied 68 percent of its funds, 
with the remaining 32 percent provided by industry, the federal govem- 
n» .Pt, and foundations. By 1984, however, the trend was away from 
state support, with only 50 percent of the school's funds coming from 
the state. The remaining 50 percent of the $3.5 million budget came 
fron such external sources as industry, the federal government, and 
foundations (including industrial sponsors). 



Much of the Physiology and Biophysics Department's improvement, as 
reported in the 1982 "Assessment cf Research Doctoral Programs in the 
United States," has occurred since 1979 when a new chairman was 
hired. According to the department chairman, the goal of the univer- 
sity's administration and departmental faculty was to accelerate the 
modest expansion that had taken place in previous years and generally 
to broaden the scope of research in the department. The department 
emphasized recruiting new faculty, consolidating the faculty into a 
single functional unit, purchasing new scientific and word processing 
equipment, restructuring the graduate program, and starting a series of 
departmental seminars featuring nationally recognized speakers from 
other universities. Of these stated goals, the chairman told us that the 
department has been most successful in improving the quality of its 
faculty and increasing the number and quality of its postdoctoral fel- 
lows. University officials attributed much of the department's improve- 
ment to a supportive and flexible university administration, a 
substantial increase in state funding, and the strong leadership of the 
new department chairman. A suDstantial increase in external funds also 
helped finance the program improvement initiatives. 
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The department chairman, in reflecting on the improvement in quality 
of the department, stated that his number one priority upon arriving 
was to build a strong research program. He believed this could be 
achieved by hiring the best possible researchers in their respective 
fields. Because of the university's willingness to hiie faculty at all ranks 
and to pay highly competitive salaries to get them, the department has 
been successful in attracting 10 researchers since 1979. The chairman 
described these researchers as outstanding and as having international 
stature in their research field. These faculty members have aggressively 
sought external research funds that have helped to support the program 
improvement plans. 

Funding for the department has grown dramatically over the last 10 
years. In 1975, for example, the total departmental budget was only 
$464,880. It had grown to $1.7 million in 1980, but by 1985, the budget 
had increased to more than $5.5 million. Department officials estimated 
that individual project grants make up at least 90 percent of awards in 
thhir department, and that the ability to compete successfully for 
external research money is one key to the program's success. Most of the 
increased funding has come from additional federal mon y for research, 
but substantial increases also occurred in funds from state appropria- 
tions and from nonfederal health agencies such as the American Heart 
Association, the American Cancer Society, and th^ Cystic Fibrosis 
Research Center. According to University officials, '*seed money'' from 
the university's state appropriation helped start the program improve- 
ment initiatives. 

The Physiology and Biophysics Department Chairmaii told us that the 
department has also been successful in attracting outstanding f^raduate 
and postgraduate students. The most impressive growth has been in the 
number of postdoctoral fellows. In 1979, for instance, the department 
had only seven postdoctoral fellows. By 1984 that number had grown to 
22, compared with a national average of 6 in a typical physiology 
department. 



University of Georgia university officials cited several factors that have been responsible for 

^ the improvement in the Botany Department. 

• The university was committed to developing an excellent department. 

• In 1967 the university received a $6.0 million nsf Science Development 
Grant. The Botany Department's share of the grant was $972,000. These 
funds and a commitment of funds from the state government enabled 
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the de':^artment to increase the faculty size from 15 to more than 20 and 
to purchase new equipment. 
» The state provided over $3.4 million to build a new 157,000 square foot 
plant sciences building and allocated to the Botany Department 60,000 
square feet for teaching and research facilities. 1 he new space assisted 
in the lecruitment of desired faculty specialists, and shared space pro- 
moted interdepartmental cooperation and communication. Pa t of the 
cost of this nev; building ($500,000) fame from an NSr Science Develop- 
ment Grant. 

• The university provides start-up funds for new researchers. Depending 
on the area of research, start-up costs range from $15,000 to $100,000 
per researcher. For example, it costs about $100,000 to set up a plant 
molecular biologist with the necessary laboratory facilities and equip- 
ment to compete for external funding. 

• Strong leadership from the university administration and Botany 
Department faculty promoted and encouraged research, which attracted 
external research funds. Federal research funds, for example, grew 
from $41,000 in 1965 to almost $17 million in 1984. 

• In more recent years, income from a $l-million endowment fund, desig- 
nated solely for the Botany Department, has also provided substantial 
unrestricted money that the department can use for special needs such 
as research equipment, student assistance, and travel. 

Along with the improvement in faculty, research equipment and facili- 
ties, *^*>e department chairman believes the quality of graduate students 
has also improved. Currently, the Botany Department has about 50 
graduate students, about 30 of whom receive leaching assistantships 
and 20 of whom have grant funds. 

Although NSF's Science Development Grant served as a catalyst for pro- 
gram improvement, university officials believe that the individual 
research grant has been the m^yor funding mechanism that has sus- 
tained the program improvement momentum. They believe a depart- 
ment needs start-up or "seed money" to attract high-quality faculty and 
provide necessary research space and equipment, but '^fter that, the 
individual research grant is the mechanism for achieving the highest 
quality science research. 

The Botany Department has experienced remarkable growth in funding. 
Federal funding has grown from $41,000 in 1965, to $405,000 in 1970 
(includes part of the NSF Science Development Grant) to almost $17 mil- 
lion in 1984. Total department funds from the state and federal govern- 
ments, industry and foundations, and endowment income grew from 
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$1.7 million in 1980 to more than $3.0 million in 1984. Most of this 
growth has been in federal research funds through individual research 
grants. 



According to the Physics Department Chairman, since receiving an nsf 
Science Development Grant in 1966, the department has made progress 
in improving the quality and number of faculty and graduate students 
and in improving its overall research program. Funds provided by the 
grant were used for (1) additional faculty, (2) initiation of new research 
activities, (3) establishment of a Faculty Associate Program whereby 
recent doctoral recipients were brought to campus for 2-year periods of 
introduction to teaching and research, and (4) initiation of a program of 
curriculum development. University administrators stated that a m^uor 
pooitive effect of the nsf Science Development Grant was the opportu- 
nity it provided for bringing in high-quality junior and senior faculty 
with initial research support at a time when few universities could Pi.o- 
vide such funding. The Physics Department had 25 faculty members in 
1965 but, with this grant, the faculty grew to 40 by 1968. The depart- 
ment has continued to grow aiid currently has a faculty of 65, including 
2 Nobel laureates and 5 members of the National Academy of Sciences. 

In addition to improving the quality of the faculty, the quality and 
number of the graduate students has also improved. According to pre- 
sent and former department chairmen, graduate enrollment has 
increased from 100 in 1965 to over 250 in 1985. In addition, postdoc- 
toral fellows have increased from none in 1965 to over 100 in 1985. 

Expenditures for the Physics Department have increased from $1.9 mil- 
hon in 1970 to $10.8 million in 1984. Income from private endowment 
has greatly strengthened the department financially. At the time of our 
visit, the department had six endowed chairs at $1 million each, six 
endowed professorships at $100,000 each, and one lectureship. In addi- 
tion, the University of Texas System has an endowment valued at about 
$2 billion. Income from the endowment is about $150 miUion per year 
with two-thirds going to the University of Texas System and one-thiid 
going to the Texas A&M System. With this endowment income, the uni- 
versities pay off bond obligations, finance construction projects, and 
provide funds for overall program improvement at the sc'-ools. 
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One important feature of the University of Texas at Austin's funding 
procedures is that the university matches federal grant funds desig- 
nated for eq^'ipment. For example, if a researcher in the Physics Depart- 
ment receives a $100,000 federal grant that includes $20,000 for 
equipment, the university will provide matching funds for the equip- 
ment part ot the grant. A university official told us this matching proce- 
dure is a ve y effective ^nethod of improving the department's research 
program. 

As mentioned earlier, the Physics Department '""hairman told us that the 
NSF Science Development Grant awarded in 1966 was a msyor factor in 
the overall improvement of Texas' Physics Department. However, when 
we discussed w^th university officials the success of this grant, they 
cautioned us about the widespread use of this type of funding mecha- 
nism. School officials told us that the success of development grants 
depends greatly on proper plaiming for the use of the funds. For 
example, if the funds are used to increase the number of faculty ir the 
department, the university must be able to absorb these faculty costs 
whenever the grant funds are discontinued. Otherwise, the aniversity 
might have to reduce its faculty and the school would be back where it 
was in the beginning, before the grant funds. 



In the development of productive university research organizations, 
funding mechaiusms play different ^oles at different stages. The 
common element that was reported to us in improvement at the univer- 
sities we visited was an explicit commitment from the university to 
improve its program and to do so through increases in internal and 
external funding and personnel changes. 

Seed funding from either government or private sources was reportedly 
a prerequisite to program improvement in all of the departments we vis- 
ited. Two of the five departments we visited received substantial nsf 
Science Development grants in the late I960's. University officials at 
both schools agreed that the availability of these federal grants was a 
mgjor factor in their program improvement strategy and enabled each 
department to attract excellent researchers, renovate research space, 
and purchase critical equipment. Although the other three departments 
did not receive science development grants, they were able to obtain 
financial support from the university, state government, and industry. 

After the investment of seed money in the departments we visited, 
faculty members competed successtuDy in their fields, ard the primary 
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source of support became the individual project mechanism. These 
moneys, along with supplemental support from state govenmiv nt, 
endowments, industry, or university funds, can generally sustain the 
quality program, at least in the short run. In the departments we visited, 
the universities* commitment to absorb the increased faculty costs when 
the science development grant or other seed money ended, helped sus- 
tain the high-quality programs and allowed the depaitments time to 
secure adequate external funding to make them predominantly self-sup- 
porting. The seed money was thuc "leveraged'* to obtain a broader base 
of support. 
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The House Science and Technology Committee requested that we assess 
the relative merit of different funding mechanisms in terms of their 
effects on the productivity and performance of research. Whi^e the pre- 
vious chapter focused on factors affecting the improvement of program 
quality, this chapter examines the impact of two different funding 
mechanisms on the performance of research. We compared five derail- 
ments that rely primanly on the funding mechanism of individual pro- 
ject grants with five centers that rely primarily on the funding 
mechanism of center support For each department or center, we 
examined four key factors that had the potential to affect the i)erform- 
ance of research — coverage of reseai'^h requirements, stability of finan- 
cial and resource support, the influence of funding mechanisms on the 
flexibility to pursue new and different categories of research, and 
administrative burden. (See objectives, scoj)e, and methodology m 
chapter 1.) While our primary focus was to identify the impact of two 
funding mechanisms on these key factors influencing the performance 
of research, the case scudy approach also provided insights into other 
influences on the performance of research. 

We found that particular funding mechanisms, such as individual 
project awards, do not by themselves have consistent advantages or dis- 
advantages for the performance of university research. With few excep- 
tions, no cleai'-cut differences emerged between the experience of 
center- and department-based scientists with federal support. The 
nature of the funding and the extent of resource coverage depend upon 
many factors, such as differences between agencies, university policies, 
and varying resource needs. We also found that: 

- bistinctions between individual project awards and center funding are 
blurred by scientists' strategies to increase their ability to perform 
research, for example, grant applications to multiple sources. 

• Certain characteristics of the individual project award mechanism result 
in some problems, for example, discontinuous funding for graduate 
students. 

• Issues specific to each field of science, a^i well as certain characteristics 
of funding mechanisms, can impede the performance of research. 

The remainder of this chapter highlights findings from our analysis of 
the impact of funding mechanisms and ocher influences on four key fac- 
tors with the potential to affect research performance. 

Appendix I summarizes the responses of all scientists to selected 
questions. 
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The performance of research requires continued coverage of resource 
requirements. Scientists need trained technicians, equipment, and space 
to conduct laboratory experiments and other research. Fields of science 
differ in their resource requirements, depending on the stage of each 
eld's develc/pment and its technological requirements. For example, 
machematicians working on "pure" theory may work in isolation with 
few assistants and little or no equipment. In contrast, cell biologists told 
us they May utilize a number of lab assistants, while space scientists 
told us they may need large amounts of capital for equipment. In such 
labor- or capital-intensive fields, interruptions or delays in access to 
resources can slow research progress or force dissolution of established 
research teams and laboratories. 

We found that while certain fionding mechanisms provided more contin- 
uous access to resources, the design of specific mechanisms seemed to 
have less effect on the performance of re^. ^rch than the total voliune of 
funding available for different fields of science and fluctuations in that 
funding. The responses of scientists regarding their ability to acquire 
needed resources clustere ' more by fields of science than by exi)erience 
with particular funding mechanisms. 

The lack of variation in responses from scientists receiving support from 
center o^ individual project awards to cover resource requirements 
might be accounted lor by a number of other issues mentioned by the 
scientists we interviewed. The coverage of resource requirements 
reflects interactions between an agency's decisions resulting from its 
review process and policies and an individual scientist's definition of 
resource m ids for a specific project in a given field of science. Resource 
coverage may be influenced by 

• the degree of variation among types of support, even within a single 
funding mechanism category; 

• differences in agency review processes; 

• agency policy decisions, such as use of funds to cover equipment or 
graduate education; 

• the extent to which universities supplement resources; 

• the types of research undertaken, as well as the scale of research 
efforts; 

• individual scientists* perceptions of me extent to which their funding 
requests will be approved; and 

• scientists* informal knowledge of what criteria govern decisions made 
by agency officials or groups of scientific reviewers. 



CJoverage of Resource 
Requirements 



Q Page 25 6A0/RCEI>^75 Univeniry Funding 

ERLC 2^ 



ChMpVu 3 

Rcle of Ponding Mechanisms in the 
Performance of Research 



These interactions can be better understood in the context of three 
resource coverage areas we examined: facilities, equipment, and human 
resources. 



F'acilities and EJquipment Experience with individual project or center awards did not apj)ear to be 

the significant factor in affecting scientists' responses to questions con- 
cerning adequacy of equipment and facilities. Instef^d, j)erceptions of 
problems in these areas differed by field of science. 



Overall, 28 of 36 researchers who had been in the federal award system 
since 1970 said that the quality of facilities for their research had 
increased or stayed the same. Scientists in two ^ields — plant sciences 
and artificial intelligence — difi not report decreases in quality of facili- 
ties since 1970. Scientists reporting decreases were in cell biology, math- 
ematics, and space science. 



Tabid 3.1: Facilities 







Figures In percentage 






Increased Same Decreased 


Has the quality of faciltties 
changed since 1970? 


Center 
Department 


42 9 21 4 357 n=14* 
54 5 31 8 13.6 n=22 



*"n" here and through the text indicates number of scientists who responded to the question 



Differences among fields of science were also seen in equipment cov- 
erage. Although scientists in all fields, with the exception of mathemati- 
cians, expressed concern over equipment, space scientists showed the 
most concern (8 of 1 1). They told us that much of their equipment is 20 
years old and is maintained periodically by scientists and technicians. In 
addition, as table 3.2 shows, over half of the scientists stated that 
needed equipment is difficult to obtain. There are no clear-cut differ- 
ences in the experiences of center and department scientists in the eas j 
or difficulty in obtaining equipment. 



Table 3.2: Equipment 



Figures In 
percentage 



Agreed Disagreed 



The equipment I need is very difficult to Cente; 54 5 45 5 n=22 

obtain under current programs Department 53 3 46 7 n=30 
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Hainan Resources The funding mechanism*^ looked at were not the most significant 

factor influencing responses by scientists to our questions about cov- 
erage of such human resources as technicians and graduate students. 
Problems with funding for technicians cut across a number of fields of 
science — cell biology, plant science, artificial intelligence, and space sci- 
ence. Scientists attributed problems with hiring and retaining techni- 
cians to factors olher than funding mechanisms, such as industrial 
competition and current salary structures for technicians at different 
universities. 

Table 3.3 indicates that both center and department scientists view this 
as a problem. Center scientists felt more difficulties with the avaiiabUity 
of technicians, although both center and department scientists reported 
difficulties in supporting technicians. 

Table Ttchniclans 

Figures in percentage 
Increased Same Pecreaaed 

Has the availability of 

technicians changed since Center 10.0 30.0 60.0 n=»lO 

1970? Department 18.2 54 5 27.3 n»11 

Agreed Disagreed 

It IS ainicult to support Center 762 23^8 n«21 

technicians needed. Department 86.4 13 6 n«22 



Problems cited by scientists relating to funding coverage for graduate 
students touched on a number of interrelated issues concerning univer- 
sity goals and funding mechanisms available for supporting these goals. 
We found variations in the types of personnel supported by university 
research groups. For example, some centers have a clearly defined 
training function, while others support research and not graduate edu- 
cation. In addition, we found that some problems associated with sup- 
port for graduate students could be traced to the ^^ype of funding 
mechanism used. Scientie^s across all fields (58 of 66) agreed that 
project support should nc*, be used to support graduate students as is 
the current practice. The negative effects they cited included the disrup- 
tion caused for graduate students by the loss of support from individual 
project awards. They suggested the establishment of separate mecha- 
nisms for graduate student support. 
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A relatively stable resource and financial environment is generally con 
sidered beneficial for the conduct of science. Particularly in resource- 
intensive areas and ones where teams of researchers must be assembled, 
the predictability of continued funding is important. The stability of 
support depends not '^nly on the continuity of funding, but also on its 
duration through a project's cycle. To determine the impact of funding 
mechanisms and other factors on the stability of support, we 3xamined: 
the cyclical nature of support, lengthy gaps between periods of funding, 
and appropriateness of award duration for the research heing 
performed. 



We found that while center support provided more continuous access to 
resources, the total volume of funding available for different fields of 
science and fluctuations in that funding seemed to have more of an 
effect on the performance of research than the design of specific mecha- 
nisms. Both center and department i>cientists we surveyed told us they 
have had their federal funding cut (table 3,4). Scientists recognized the 
cyclical nature of federal support for different topics of research. Scien- 
tists also recognized the increased opportunities to comj)ete for private 
support in areas of commercial potential and industry interest, such as 
artificial intelligence and plant biology in agriculture. 



Table Funding Cuts ^^^^^^H^^^^HI^B^^^^H^HI^HHH^^BM^^^HH 

Figures in Percentage 

No 

Have you ever had your project Center 77 4 22.6 n=«31 

funding cut? Department 833 16.7 n»36 



Scientists in fields of shifting program priorities can also be affected by 
the cyclical nature of support. For example, nsf's attempt to ensure sta- 
bility at the field of science level in mathematics by dividing available 
funds for the mathematics subfields, such as complex analysis, resulted 
in destabilizing research environments for certain other subfields and 
individuals. This example shows that the effects of funding mechanisms 
on university research carmot be assessed without consideration of con- 
textual factors such as agency policies. 

The influence of factors other than funding mechanisms on the stability 
of the support can be seen in fields of science dependent on nih funding. 
The Office of Management and Budget proposed cutting the number of 
NIH awards from 6,529 in fiscal year 1985 to 5,000 new and continuing 
awards in fiscal year 198G and further to use the savings from that 
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reduction to spread the available funds by distributing the awards over 
2 or more years instead of 1 year. Scientists in cell biology, one of the 
fields supported by NIH, told us they were concerned with the politiciza- 
tion of federal funding for research (e.g., we heard conur .nts such as 
"non-scientific events at the federal level,'' ^'arbitrary 0MB decisions,'* 
and that fluctuations "depend on the Administration"). Their percep- 
tions of instability are indicated by the contrast between their success in 
obtaining funding and an increased sense of unpredicvability (table 3.5). 



Tabto 3.5: CtMing^s Over the Last 15 
VMrs in Atw% Affecting Research 



Figures I n Perc e ntage 

Increased Same Decreased 



How has the predictability of 
obtaining federal project 
funding changed^ 


Center 
Department 


23.1 
27 3 


15.4 
27.3 


61.5 
45 5 


n=l3 
n=22 


How has your success rate in 
funding changed*^ 


Center 
Department 


10.0 
11.1 


800 
667 


100 
222 


n=10 
n=18 



Funding Gaps 



We found that the type of funding mechanism uoed had a more signifi- 
cant impact in the area of funding gaps than in other areas related to 
stability. For departmental scientists who received individual project 
awards, rather than center fimding, fiuiding gaps sometimes translated 
into ending support that broke up research te^ms and caused the loss of 
trained professional technicians. Scientift^ noted that the social and eco- 
nomic costs ot funding gaps (human suffering, retooling, increased time 
exi)ended by scientists in the day-to-day operations of the lab) were an 
intangible cost in the performance of research. 



In contrast, we found that the center mechanism provided a measure of 
flexibility that enhanced the stability of the research environment for 
those scientist: who received center support. Scientists cited the 
informal sharing of resources possible luider center fanding as one con- 
tributing factor to stability of funding. Center fimding provides some 
seed money to start research that would otherwise *oe unfunded and 
bridges periods when noncenter funds are terminated. Finally, it can 
provide for more continuous support of professional technicians. 
Funding gaps in the centers were seen as delays in funding, rather than 
PS an end to support. 

Although center support provided more stability in funding, we found 
that some department scientists had developed strategies that seemed to 
compensate for funding gaps. To prevent an abrupt stop to their 
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research, scientists will apply to multiple sponsors in order to guarantee 
the continuity of their work. When one project euds, the researcher is 
still receiving support from other sources. A second device is the prac- 
tice of working as a co-investigator on L,)meone else's award. To meet 
equipment needs, scientists in one department we visited collaborated 
and were able to pool resources from vaiious project awards in order to 
establish eq oipment for common use. 



Table 3.6: Funding Qapt 



Figures in 
Percentage 

Yes No 

Have funding gaps been a problem? Center 27.6 72 4 n=29 

Department 50 0 500 n=34 



Award Duration Scientists receiving both types of mechanisms expressed concern about 

av/ard duration (table 3.7). However, scientists in most of the centers we 
studied commented that they had a longer term commitment under the 
center mechanism than scientists who received individual project 
awards. Award duration affects stability because award periods do not 
always match the actual time needed to perform research, which can 
vary even within a field. For example, one scientist told us that bio- 
chemistry projects take considerably less time to complete than genetic 
manipulation experiments in agriculture, where scientists must allow a 
complete regeneration of crops before testing can take place. Scientists 
also suggested that for many fields, shorter duration awards (less than 2 
years) did not recognize start-up time as a legitimate facet of research 
and thus did not permit the following of coherent research strategies. 
Finally, scientists recognized the difference between the long-term way 
in which they perceive research (scientists conceptualized their work as 
!ife long, or in terms like **a 50-year project") and the relatively short- 
term way in which funding agencies perceive research (in 3-to 5-year 
increments). 



Table 3.7: Experience With Federal 
Awards 







Figures in Percentage 








Agreed 


Disagreed 




Award periods are too short to finish a 


Center 


593 


407 


n«27 


project within one award cycle 


Department 


618 


382 


n-34 


There's not enough time to complete 










scholarly articles during the project 


Center 


45 2 


548 


n«3l 


award pieriod. 


Department 


545 


45 5 


n=33 
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Some differences in the types of research supported emerged between 
the two mechanisms studied. One criticism of the individual project 
award review system is that it does not adequately support inr^ovative, 
high-risk research. A task force of the National Science Foundation 
Advisory Council identified the following three classes of inno /ati^ e, 
high-risk proposals: research that challenges currently accepted scien- 
tific hypotheses; interdisciplinary proposals or research that transfers 
knowledge from one scientific field to another; and research that is at 
the edge of technical feasibility. To determine which mechanisms (cen- 
ters or individual project awards) more often support innovative, high- 
risk, and interdisciplinary research, we asked scientists a series of ques- 
tions about their research. 

We found that more scientists in centers are likely to j)erform the types 
of research defined as iimovative, high risk, or interdisciplinary. More 
center than departmental scientists: 

• performed research bridging two or more fields (30 of 32 center scien- 
tists versus 21 of 36 departmental scientists); 

• proposed research into new areas (25 of 32 center scientists versus 14 of 
33 departmental scientists); and 

• proposed work with industrial apphcaticns (9 of 32 center scientists 
versus 3 of 33 departmental scientists). 

Although innovati\ e, high-risk, and interdisciplinary research tended to 
be performed by scentists in centers, in certain cases the field of sci- 
ence, not the affiliation with a center or department, seemed to influ- 
ence the types of research performed. For example, ail plant scientists in 
the center and department (1 1 of 11) described their research as inter- 
disciplinary, bridging two or more fields. Differences were not clear cut 
between scientists who proposed new technical processes with support 
from the center or individual proj3ct awards. Few mathematicians had 
proposed new technical processes (3 of 20) or proposed research into 
new areas (7 of 13). In contrast, almost all plant scientists (10 of 11) and 
scientists in artificial intelligence (8 of 9) had proposed research in new 
areas. 



Types of Research 



Adltlirdstrative Burden aspect of the current reliance on the individual project award 

system that has been criticized by scientists is the time and expense of 
preparing and administering a large volume of applications. Time spent 
by scientists in preparing and reviewing research proposals is seen as 
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resulting in a decline of research productivity. Discussion has also sug- 
gested a need to streamline procedures for administering grants and 
contracts, without reference to the particular funding mechanism 
involved. 

The time commitment by scientists required to participate in the federal 
funding system caii be divided into two categories: preaward and post- 
award. This time encompasses not only proposal applications, but also 
responses to sponsoring agencies' requests for proposal review, partici- 
pacion in technical monitoring, and the preparation of status and final 
work reports. 

We examined the relative amount of time spent in award-related activi- 
ties by scientists receiving center support and those depaitmental scien- 
tists receiving support from individual project awards. We were also 
interested in whether scientists perceived differences in administrative 
burden between sponsors. We also asked imiversity administrators to 
comment on these issues. 

We found that, for the scientists we interviewed, the amount of time 
spent applying for awards, responding to award requirements, and 
reviewing proposals varied not by type of mechanism but more by the 
field of science and the requirements of the dominant agency sponsoring 
research m each field. We also found that no single issue emerged among 
these 70 scientists regarding the presence of administrative burden 
Scientists' perceptions of difficulties in this area can be shaped by a 
number of factors: whether individuals or groups submit multiple appli- 
cations in order to obtain federal a ^ards, the number of researchers in 
relationship to available funding, and changes in agency requirements. 
We found that scientists at the schools we visited tended to cite a 
number of problems when specifically asked about administrative 
burden, ranging from the time spent in responding to regulations 
imposed by different governmental bodies to time svA effort reporting. 
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TM% 3.8: Av«rag« Time Spent by ■^^■^■■^■■■■■■IH^Hi^HHHHdH^^^HaBBHHHHH 

SdMtlste in Award-Related Activities Writing Proposal Status Technical Noncompetitive 

applications review days/ reports monitoring renewal dsys/ 
weeks/year year days/year days/year year 



FIELD OF 
SCIENCE 



Plant science 


56 


185 


63 


36 


37 




n=10 


n=11 


n=11 


n=10 


n=9 


Cell biology 


47 


155 


54 


31 


1 1 


n=12 


n=10 


n=14 


n=14 


n=14 


vlathematics 


20 


5.9 


26 


8 


1 9 




n=20 


n=20 


n=18 


n=16 


n=14 


Space science 


35 


77 


4 1 


1.2 


35 




n=11 


n=l2 


n=11 


n=11 


n=11 


Artificial 


39 


97 


66 


64 


1 9 


intelligence 


n=10 


n=10 


n=9 


n=9 


n=9 


All scientists 


36 


106 


4/ 


27 


2.3 




n=63 


n=63 


n=63 


n=60 


n=57 



Table 3.8 lists differences among fields for the 10 schools we visited in 
the amount of time spent in activities. Differences result from variation 
in agency requirements for funding research rather than from the type 
of mechanism employed. The msyor distinctions among fields seemed to 
be in the area of preaward and postaward requirements. Scientists 
receiving funding from the Department of Defense, the National Aero- 
nautics and Space Administration, and the Department of Energy (agen- 
cies that make decisions internally or through combined internal and 
external review) might spend less time on proposal review, one example 
of a preaward requirement, than scientists supported by nsf and nik. nsf 
and NIH use only one form of decision making, peer review, a process 
designed to have groups ox scientists to review the merits of work pro- 
posed by colleagues in various specialties. In contrast, researchers in 
artificial intelligence spent more time responding to the requirements uf 
technical monitors, a postaward requirement common m research 
funded by the Department of Defense. Three scientists in artificial intel- 
ligence, a field that receives support from both civilian and defense 
agencieSy perceived nsf to be the most burdensome in preaward require- 
ments and least demanding in postaward requirements compared to 
defense a^^encies. 

While there were no clear-cut differences overall in the administrative 
requirements, we found that sor . centers are designed in such a way as 
to insulate staff from the burden of administrative tasks. For example, 
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at one university the center director had a small core staff to handle the 
writing of proposals and other avard-related tasks. 

One postaward issue we specifically addrecsed concerned the ease or 
difficulty in shifting funds between expenditure categories (table 3.9). 
V/e asked researchers whether they found it difficult to shift funds 
between categories. We wanted to kiiow whether they had the flexibility 
to shift resources in the event of unexpected events such as a change in 
the direction of their research. This did not seem to be a clear-cut issue 
for center investigators, who split on their responses to this question. In 
contrast, more department scientists (25 of 34) found it easier to shift 
funds. CJertain restrictions seem to lead some researchers to resort to 
other sources of funding rather than attempt to acquire approval for 
such expenses as travel or equipment. However, several researchers 
praised nih and nsf, agencies that have decentralized administrative 
responsibility for overseeing shifts in expenditures to the university 
level. We also found examples of unique forms of the individual project 
award that are flexible in character, such as general research contracts 
from the National Aeronautics and Space Administration and the Office 
of Naval Research. 

General research contracts have broad objectives and provide the prin- 
cipal investigator with considerable discretion in how the funds are 
used. Among other uses of these contracts, the principal investigator can 
support young investigators who have not established a performance 
record or technicians and graduate students during funding gaps. 

Shifting Fundw ^H^^HB^^^^^^BH^H^H^^^^^^^H^H^^^HH 

Figuf in PTcentaga 
AgrMd__L>iMigreed 

It IS difficult to shift funds Center 50 0 ^0 n=22 

between expenditure categories Department 26 5 73 5 n=34 



For university administrators, three factors affect the amount of time 
spent in administering federal research awards. Administrative time can 
be increased by institutional policies for review, differences in the pro- 
cess of negotiating and administering contracts with different sponsors, 
and difficulties with specific legal instruments rather than funding 
mechanisms. 



Our case studies of the role of different funding mechanisms in 
enhancing or inhibiting research performance show that particular 



Summary 
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funding mechanisms we looked at do not always have consistent advan- 
tages or disadvantages in the performance of research. Performance of 
research can be affected by any of the following factors: resource cov- 
erage, stability, the flexibility to pursue new research ideas, and admir- 
istrative burden. For these factors, we found issues that were either 
funding mechanijim-related, field of science-related, or cut across 
funding mechanisms and fields of science. 

In looking at the issues that relate to specific funding mechanisms, the 
center grants we examined were somewhat more likely to provide more 
continuous access to resources; to afford a greater degree of stability for 
the performance of research; and to enhance the performance of innova- 
tive, hig^ risk, or interdisciplinary research. 

Field of science-related i aes included ^e following: the cyclical nature 
of support for the field, changes in ageii relationships, and the unique 
needs of subfields. The cyclical nature support for different fields 
seemed to explain differences in resource coverage between fields. Dif- 
ferences among fields of science were seen in coverage of resources — 
facilities and equipment. For example, scientists in organizations 
receiving a relatively rapid increase in volume of funding, such as artifi- 
cial intelligence and plant biology, said that the quality of facilities for 
their research had increased or stayed the same. Space scientists, 
working in a field with stable or decreasing funding, showed more con- 
cern over the condition of their facilities and equipment. Cell biology is a 
field of science that illustrates the effects of a change in agency relation- 
ships. In this field, which is primarily supported by nih, scientists we 
interviewed described the destabilizing of their research environment 
caused by executive branch decisions to change the number of awards 
made by nih for individual project support. The unique needs of sub- 
fields can also affect scientists' experience with funding mechanisms. 
For example, the time needed to perform research can vary even within 
a field as in the case of plant biology in which it may take several years 
for a new crop to grow and be tested. 

Issues that cut across mechanisms and fields of science include the cur- 
rent problem of finding and keeping technicians. Similarly, perceptions 
of administrative burden seemed influenced by factors other than mech- 
anisms and characteristics of a field of science. Problems were attrib- 
uted to a range of factors, including university procurement policies and 
state and municipal regulations. 
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Figures in Percentage 

Stability of Financial and Resource Support 

Has the success rate in funding of federal proposals over the last 15 years changed*? 



(n=28) 

Increased 17 9 

Same 71 4 

Decreased 10 7 



Award periods are too short to finish a project within one award cycle. (n=61) 

Agreed 60.7 

Disagreed 39 3 



There is not enough time to complete scholarly articles during the project award period 
(n=64) 

Agreed 50.0 

Disagreed 50.0 



Have you had problems because of gaps in your funding'^ (n=63) 

Yes 39.7 
No 603 



Has the predictability of obtaining federal project funding changed over the last 15 years'? 
{n=35) 

Increased 25.7 
Same 22.9 
Decreased 51 4 



Have you ever had your project funding cuf? (n=67) 

Yes 80.6 
No 19 4 



Coverage of Resource Requirements 

Has the qual.ty of facilities changed since 1970'? (n=36) 

Increased 22 2 

Same 27.8 
Decreased 50 0 



The equipment t need is very difficult to obtain under current federal award program (n=52) 
Agreed 53.8 
Disagreed 46 1 



Has the availability of technicians changed since 1970'? (n=21 ) 

increased 14.3 

Same 42.9 

Decreased 42 9 



It IS difficult to support technicians needed (n=43) 

Agreed 81 .4 

Disagreed 18 6 



Types of Research 

Some projects are no* funded because they don't fit conventional areas f'4vored by 
reviewers. (n« 55) 

Agreed 41 .8 

Disagreed 58.2 



Administrative Burde n 

It IS difficult to shift funds between expenditure categories (n=56) 

Agreed 35.7 
Disagreed 64 3 



"n" indicates the number of scientists who responded to the question 
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There is a 25% discount on orders for 100 or more copies mailed to a 
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